* created individual processing functions

* extracted state dict and inserted back into instance after processing

* created weight processing shared class

* added test coverage for new functions

* updated hooked transformer to use new shared functions

* created test

* moved over weight processing

* replaced keys

* used the correct function

* created test for making sure path translation works correctly

* fixed weight processing

* added additional tests

* formatted tests a bit

* cleaned up

* fixed unit test

* fixed indentation

* fixed doc string

* fixed unit test

* fixed type

* fixed some tests

* fixed test

* fixed setup of tests

* cleaned up test

* started working through individual matches

* added test coverage

* tested function a bit

* integrated weight conversion into weight proccessing

* simplified functions

* identified individual problem lines

* identified divergences more clearly

* brought back error lines

* created individual processing functions

* extracted state dict and inserted back into instance after processing

* created weight processing shared class

* added test coverage for new functions

* updated hooked transformer to use new shared functions

* created test

* moved over weight processing

* replaced keys

* used the correct function

* created test for making sure path translation works correctly

* fixed weight processing

* added additional tests

* formatted tests a bit

* cleaned up

* fixed unit test

* fixed indentation

* fixed doc string

* fixed unit test

* fixed type

* fixed some tests

* fixed test

* fixed setup of tests

* cleaned up test

* started working through individual matches

* added test coverage

* tested function a bit

* integrated weight conversion into weight proccessing

* simplified functions

* identified individual problem lines

* identified divergences more clearly

* brought back error lines

…for already initialized components (#1066)

* imporoved accuracy a bit

* got models to match

* removed forward pass stuff

* cleaned up weight processing a bit

* removed working attention

* restored files

* imporoved accuracy a bit

* got models to match

* removed forward pass stuff

* cleaned up weight processing a bit

* removed working attention

* restored files

* created loop to verify weight conversion

* finished compatibility layer

* finished testing hugging face weights

* setup correct init

* added some tests

* removed seperate component

* fixed some integration tests

* moved final layer norm

* moved layer norm forward

* cleaned up more things

* updated attention weight loading

* fixed function names

* fixed some ci issues

* fixed type issues

* ran format

* fixed test

* fixed type issues

* fixed type issue

* fixed type issue

* fixed test

* fixed test

* fixed issues

* ran format

* fixed typing

* fixed tests

* fixed tests

* simplified test

* sped up tests

* added check for kv cache

* ran format

* skipped some tests

* marked a couple tests to skip

* ran some more optimizations

* ran poetry lock

* regenerated lock

* fixed commands

* set random seed

* updated parallelism prop

* updated command

* reverted some changes

* updated notebook settings

* updated verbosity

* removed extra test

* cleaned up tests some more

* marked test as skipped

* fixed more tests

* sped up CI

* reverted CI changes

* reverted actions changes

* improved cache

* sped up some tests

* optimzed more tests

* sped up some more tests

* made more speed improvements

* fixed error

* fixed typing

* cleaned up some debug points

* fixed attention hooks

* enabled hooks in test

* split out some tasks into their own jobs

* removed bad file

* updated name

* fixed batch dimension

* removed log point

* fixed potential error

* sped up load

* ran format

* improved hf cache handling

* fixed bridge

* fixed cache again

* added more checks

* removed parallel execution

* fixed cache hooks

* fixed test and typing

* fixed test

* fixed bias displaying

* fixed ablation issue

* fixed type issue

* setup new hooks properly

* fixed type checks

* fixed alias hook props

* ran format

* made all hooks show properly

* ran format

* fixed type checks

* updated loading in main demo to use transformers bridge

* updated model name

* updated imports

* updated some cells

* reran demo

* updated some cells

* reran some cells

* reran demo

* ran demo again

* finished generating new cells

* Update README.md (#957)

Update link to Streamlit tutorial and guide.

Co-authored-by: Bryce Meyer <[email protected]>

* improve model properties table in docs (#769)

* add static to gitignore

* making a meaningless change to see if tests pass at all

* making a meaningless change to see if tests pass at all

* add interactive table static html only

adding things one at a time to see what causes things to break

* run poetry update with no changes to deps

* revert lockfile change

* add tiktoken >=0.7.0 to group docs

* add dep muutils >=0.6.15 to group docs

* add improved interactive table generation

we still generate a plain markdown table

code is from the old PR: https://github.com/mivanit/TransformerLens/blob/add-better-model-properties-table/docs/make_docs.py
which is in turn a modified version of https://github.com/mivanit/transformerlens-model-table

* fix format -- missing trailing newline

* fix type hints for compatibility

* fix torch device meta in make docs script, also improved hot reload

* TEMPORARY: allow_except when getting models to deal with mixtral HF_TOKEN issue

* added simple test for get_model_info

* context manager for controlling device, tests were breaking due to default device meta

* formatted with wrong version of black, oops

* fix path to generated model_properties_table

* fix md table header, add title in yaml frontmatter

* add line to frontmatter yaml, re-run tests bc huggingface down?

* do not allow exceptions when getting models

* re-run poetry lock

* attempt fix lockfile

* re-run poetry lock

---------

Co-authored-by: Bryce Meyer <[email protected]>

* switch pyproject from toml to uv, generate lockfile

also update tiktoken dep for 3.13 compatibility

* update makefile to use uv

* update actions

* hack to get version to work

* wip

* make dep

* update contributing.md to reflect switch from poetry to uv

* add type hints to supported_models

* fix paths in make_docs.py

* docs group not in default, update install instructions for docs

* POETRY_PYPI_TOKEN_PYPI -> PYPI_TOKEN_PYPI

* make format

* fix default groups, re-add docs

* add some deps needed in notebooks

* removed use of torchtyping in othello_GPT.ipynb and deps

- torchtyping causes various issues if it's imported
- presumably jaxtyping should be used instead??
- othello GPT notebook doesn't actually use the imported TT
  - shouldn't a linter/formatter catch this sort of unused import?

* fix: add pythonpath "." to pytest config for test imports

Configure pytest to include project root in Python path, enabling
`from tests.foo import bar`
style imports, which were broken by switching to uv

* attempt jupyter issue fix

* issue ref explaining ipython version restriction

* updated ci commands after recent work

* fixed more setup items

* added tabulate dependency

* updated make docs command

* updated dependencies

* fixed docs

---------

Co-authored-by: jmole <[email protected]>
Co-authored-by: Bryce Meyer <[email protected]>

* setup tests for hooks

* ran format

* merged legacy hooks tests

* ran format

* enabled compatibility mode

* added remaining hooks

* fixed type issue

* added main demo cached output

* removed debug items

* reran notebook

* marked cell for skipping

* reran notebook

* regenerated demo

* regenerated notebook

* updated loading in arena content demo to use transformer bridge

* updated install reference

* removed extra params

* ran some cells

* updated arena notebook

---------

Co-authored-by: Bryce Meyer <[email protected]>

* regeneerated with new hooks

* ran first cell

* added test coverage for ensuring compatibility

* ran format

* fixed unit tests

* resolved type issue

* added init files

* added init file

* fixed tokaize function

* fixed attention mask issues

* reverted invalid change to test

* created test that asserts hook shapes for various models

* created initial doc for explaining transformer bridge model structure

* ran format

* cleaned up docs and enabled test

* ran format

* imporeved hook test

* ran format

* did some memory cleanup

* added more hook shape coverAGE

* made more optimizations

* fixed type checking

* cleaned up comments

* removed additional comments

* fixed gradian scale

* ran format

* resovled merge issue

* adkded test for all forward passes

* fixed hook z shape

* matched attention hook

* updated function location

* created backward test

* worked through some backwards hooks

* resolved backwards issue

* fixed type issues

* fixed docstring test

* fixed docstring

* fixed tests

* improved hook compatibility

* split weights before for joint qkv

* updated the way split qkv works

* aliased hook properly

* lowered test tolerance

* updated tolerance

* fixed type checks

* improved gradients

* revisted test

* fixed type checks

* added hook to block

* updated gemma 3

* fixed gemma 3

* fixed format

* excluded remaining hooks

* regenerated arena demo

* ran format

* reran demo

* fixed shape issue

* regenerated main demo

* added ignore block

* reran cell

* fixed block

* fixed ci bugs

* fixed test

* updated tolerance

* revised rates

* backed off on tolerance

* added test coverage for ensuring compatibility

* ran format

* fixed unit tests

* resolved type issue

* added init files

* added init file

* fixed tokaize function

* fixed attention mask issues

* fixed utils

* fixed dtype

* tested llama 3.1

* removed extra file

* fixed eps access

* brought rotary_emb back

* added param

* connected correct bridge

* fixed hook duplication

* moved tests

* fixed new tests

* ran format

* regenerated demo

* tightened tolerance a bit

* Revert "regenerated demo"

This reverts commit 50adba0.

* fixed cache location bug

* reverted test

* removed comment

* cleaned up fix

* cleaned up fix

* cleaned up hook_out

* restored shape checking

* cleaned up solution moire

* regenerated demo

* reran cell

* regenerated main demo

* regenerated demo

* tested llama 3.1

* removed extra file

* fixed eps access

* brought rotary_emb back

* added param

* ran initial gemma 2 fix

* connected correct bridge

* changed to hook cos and sin

* passed test

* updated embedding implementationg

* reverted embedding changes

* updated return

* updated param order

* skipped test in CI

* skipped test properly

* resolved experts mapping issues

* ran format

* Fix GPT-OSS JointGateUpMLPBridge hook alias resolution and add tests

This commit addresses hook alias resolution issues for GPT-OSS MoE models
and adds comprehensive unit tests.

Changes:
1. Fixed JointGateUpMLPBridge hook_aliases to use gate.hook_out instead of
   in.hook_out/input.hook_out, which don't exist in this bridge type
2. Added 7 comprehensive unit tests in test_gpt_oss_moe.py that verify:
   - Model loads without downloading weights (using meta device)
   - Bridge creation works correctly
   - MLP uses JointGateUpMLPBridge (not regular MLPBridge)
   - Compatibility mode hooks are accessible
   - Experts structure is correct (batched tensors, not iterable modules)
   - Hook aliases resolve correctly
   - No incorrect BlockBridge wrapper around experts

Root cause:
- JointGateUpMLPBridge inherits from MLPBridge which has hook_aliases
  expecting in.hook_out or input.hook_out submodules
- JointGateUpMLPBridge creates gate and up submodules instead, causing
  AttributeError when resolving aliases
- Solution: Override hook_aliases at class level to use gate.hook_out

Testing:
All 7 tests pass, verifying GPT-OSS loads correctly and hooks work in
compatibility mode without downloading the full 20B parameter model.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <[email protected]>

* added model name to avilable models

* added eps config

* updated to rotary bridge

* passed through to parent

* fixed tuple passing

* changed oss bridge

* fixed gpt oss activations

* ran format

* removed colab compat from checks

---------

Co-authored-by: Claude <[email protected]>

* created benchmark suite

* fixed type issues

* fixed type issues

* finalized t5 adapter

* tested t5 architecture

* fixed type issues

* resolved experts mapping issues

* Revert "resolved experts mapping issues"

This reverts commit 9fa5125.

* ran format

* improved various models

* improved llama

* fixed benchmark utils now

* fixed test

…er (#1103)" (#1108)

This reverts commit 931b45f.

* finalized bench mark logic

* ran format

* improved various models

* improved llama

* fixed benchmark utils now

* fixed test

* fixed opt adapter

* fixed phi-3

* fixed format

* fixed type issues

* added line break

* fixed phi-3